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Abstract 

We continue the study of counting complexity begun in |1 II 1141 IT3] by 
proving upper and lower bounds on the complexity of computing the Hilbert 
polynomial of a homogeneous ideal. We show that the problem of computing 
the Hilbert polynomial of a smooth equidimensional complex projective variety 
can be reduced in polynomial time to the problem of counting the number of 



■ complex common zeros of a finite set of multivariate polynomials. Moreover, 



we prove that the more general problem of computing the Hilbert polynomial 
of a homogeneous ideal is polynomial space hard. This implies polynomial 
space lower bounds for both the problems of computing the rank and the Euler 
characteristic of cohomology groups of coherent sheaves on projective space, 



> 

\ improving the ^P-lower bound in Bach p^. 

o ' 

O ! 1 Introduction 

in 
o 

o 



Despite the impressive progress in the development of algebraic algorithms and 
computer algebra packages, the inherent computational complexity of even the most 
basic problems in algebraic geometry is still far from being understood. In a 
systematic study of the inherent complexity for computing algebraic/topological 
quantities was launched with the goal of characterizing the complexity of various 
such problems by completeness results in a suitable hierarchy of complexity classes. 
In this article we continue this study by investigating the complexity of computing 
the Hilbert polynomial of a complex projective variety V C P™. This polynomial 
encodes important information about the variety V, like its dimension, degree and 
arithmetic genus. 

Algorithms for computing Hilbert polynomials were described in |42l l7llfi]. Some 
of these algorithms have been implemented in computer algebra systems and work 
quite well in practice. These algorithms are based on the computation of Grobner 
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bases, which leads to bad upper complexity estimates. In fact, the problem of com- 
puting a Grobner basis is exponential space complete |38| . Both the cardinality 
and the maximal degree of a Grobner basis might be doubly exponential in the 
number of variables [HI3I1E1- It is generally believed that these bounds are quite 
pessimistic and that for problems with "nice" geometry, single exponential upper 
bounds should hold for Grobner bases. Among the results that are known in this 
direction are [241 1181 151 I38|. However, currently no upper bound better than ex- 
ponential space is known for the computation of the Hilbert function or Hilbert 
polynomial of a homogeneous ideal. 

Based on a lower bound on the homogeneous polynomial ideal membership prob- 
lem in 3§| we are able to show that the problem of computing the Hilbert polynomial 
is FPSPACE-hard, where FPSPACE denotes the complexity class of functions that 
can be computed in polynomial space by a Turing machine. As a corollary, we 
obtain an FPSPACE-lower bound for the problem of computing the rank of coho- 
mology groups of coherent sheaves on projective space as well as for the problem of 
computing the corresponding Euler characteristic (Corollary 14. lift . thus improving 
the #P- lower bound in Bach pQ. 

The bound on the Castelnuovo-Mumford regularity for the vanishing ideal of 
a smooth projective variety in [5J Thm. 3.12(b)] suggests that the computation of 
the Hilbert polynomial might actually be possible in polynomial space for smooth 
varieties. The main goal of this article is to prove a stronger result: we show that 
the problem Hilbert sii1 of computing the Hilbert polynomial of a smooth equidi- 
mensional complex projective variety V C P n can be reduced in polynomial time 
to the problem #HNc of counting the number of complex common zeros of a finite 
set of complex multivariate polynomials. (The input specification for HiLBERT sm 
involves some subtleties, see fJU) Such reduction can be established in the Turing 
as well as in the Blum-Shub-Smale model of computation ||J|S]. In particular, in 
the Turing model we obtain an FPSPACE-upper bound for the discrete version of 
Hilbert si11 , where the inputs are integer polynomials. 

These results are interpreted in the framework of counting complexity. In 
Valiant's counting complexity class #P |48| HH] was extended to the framework of 
computations over C in the sense of [SJ. Thus #Pc is the class of functions from 
the space C°° of finite sequences of complex numbers to N U {oo} which, roughly 
speaking, count the number of satisfying witnesses for an input of a problem in NPc. 
The problem #HNc of counting the number of complex common zeros of a given 
finite set of complex polynomials (returning oo if this number is not finite) turns 
out to be complete for the class #Pj> The main results of ^2 E] state that both 
problems to compute the geometric degree and the topological Euler characteristic 
of complex varieties are polynomial time equivalent to #HNc ( jllj also contains a 
corresponding result for the computation of the Euler characteristic of semialgebraic 
sets). Hereby, "polynomial time equivalent" is meant in the sense of computations 
over C. However, when restricting the inputs to integer coefficient polynomials, the 
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corresponding discrete problems are also equivalent in the Turing model of computa- 
tion (for Turing reductions). The complexity of these discrete problems is captured 
by the Boolean part GCC of #Pc, which is obtained by restricting the functions in 
#P C to bit strings. Is is known that #P C GCC C FPSPACE One can show 
along the lines of §8.3] that the problem of computing the number of connected 
components of a complex affine algebraic variety (given by integer coefficients poly- 
nomials) is FPSPACE-complete. This implies that the problem of computing the 
topological Euler characteristic is strictly easier than the problem of computing the 
number of connected components, unless GCC collapses with FPSPACE, which we 
believe to be unlikely. 

The class captures the complexity of counting the number of solutions to 
systems of polynomial equations. It is therefore not surprising that some of the 
ideas and tools of intersection theory, enumerative geometry, and Schubert calculus 
are salient for our purposes. 

Our reduction from HiLBERT sm to #HNc consists of the following three steps: 

1. We interpret the value pv(d) of the Hilbert polynomial of V C P n on d € Z as 
the Euler characteristic xiPv(d)) of the twisted sheaf Oy(d). 

2. The Hirzebruch-Riemann-Roch Theorem |27j gives an explicit combinatorial 
description of x(®v{d)) in terms of certain determinants A^(c) (related to 
Schur polynomials) in the Chern classes Cj of the tangent bundle of V. 

3. The homology class corresponding to the cohomology class A^(c) can be re- 
alized up to sign by a degeneracy locus, which is defined as the pullback of a 
Schubert variety under the Gauss map (cf. Fulton Ex. 14.3.3]). We call 
the geometric degree of such a degeneracy locus a projective character. 

This allows to express (certain integer multiples of) the coefficients of the Hilbert 
polynomial as integer linear combinations of projective characters. We now use 
the fact that the computation of the geometric degree of varieties is possible in 
the complexity class Gap^, and that the class GaPj? is closed under exponential 
summation (Lemma 13. 8|) . Here G AP^ is a class of functions slightly larger than 
^Pp, which is closed under "generic parsimonious reductions" 13 . 

Organization of the article. In &\ we present all the necessary definitions and 
facts needed in order to state a formula for the coefficients of the Hilbert polynomial 
in terms of projective characters. While the formula is given in 32 the proof is 
postponed to Section El contains background from (counting) complexity theory 
over C. In [Jljwe present the main results of this article, the upper and lower bounds 
on the complexity of computing the coefficients of the Hilbert polynomial. Finally, 
contains the derivation of the relationship between the Hilbert polynomial and 
degeneracy loci, using the Hirzebruch-Riemann-Roch theorem. In order to facilitate 
reading, the proofs of two technical lemmas from ^2 and of a result used in ^ are 
postponed to the appendix. 
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2 Preliminaries from algebraic geometry 

Throughout this article, unless otherwise stated, the term variety will mean a com- 
plex, projective, not necessarily irreducible variety. By a subvariety we will always 
understand a closed subvariety. We will say that a property holds for almost all 
points in a variety, if the set of points satisfying the given property is a dense subset 
with respect to the Zariski topology. 

2.1 The Hilbert polynomial 

Let S := C[Xo, . . . , X n ] denote a polynomial ring and let M be a finitely generated, 
graded 5-module. Denote by the fc-th graded part of M. The function Km '■ Z — > 
N, defined by /im(&) = dime is called the Hilbert function of M. A proof of the 
following theorem can be found in |261 1.7]. 

Theorem 2.1 (Hilbert-Serre) Let M he a finitely generated, graded S-module. 
Then there exists a unique polynomial pm(T) G Q[T] such that Hm(£) = Pm(£) 
for sufficiently large i. Furthermore, the degree of pu equals the dimension of the 
projective zero set of the annihilator {s £ S \ sM = 0} of M. 

The polynomial pm{T) is called the Hilbert polynomial of M. Of special interest 
is the case M = S/I, where I C S is a homogeneous ideal. If I = I(V) is the 
homogeneous ideal of a complex projective variety V C P n , then we write py '■ = Ps/i 
and call this the Hilbert polynomial of V. We thus have degpy = dimV. 

Example 2.2 1. The Hilbert polynomial of V = F n is p v (T) = ( T ^ n ). 

2. Let / € C[Xo, . . . ,X n ] be homogeneous and irreducible of degree d and let 
V = Z(f) be its projective zero set. Then p v (T) = ( T + n ) - ( T+ "~ d ). 

Let V C P n be an m-dimensional projective variety with Hilbert polynomial 
Pv(T) = p m T m + • • • + p\T + pq. The geometric degree degl^ of V is defined as 
degy := ml p m . The degree counts the number of intersection points of V with 
a generic linear subspace of complementary dimension |25| Lect. 18]. It is additive 
on the irreducible components of maximal dimension. The arithmetic genus of V is 
defined as g a (V) := (— l) m (po — !)• While the degree depends on the embedding in 
projective space, the arithmetic genus is a birational invariant (cf. |26l Ex. III.5.3]). 
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2.2 Projective characters 



General references for the material presented in this section are |2U1 13 7j . In the 
following we assume < m < n. The Grassmann variety 



is an irreducible smooth projective variety of dimension (m+l)(n — m) |251 Lect. 6]. 

The flag variety T is defined as the set of all complete flags F of linear subspaces 
Fq C . . . C F n -\ C F n = P n , such that d\m.Fi = i for < i < n. It is an irreducible 
smooth projective variety [201 III.9.1]. 

For A G G(m, n) and a flag F € T we consider the weakly increasing sequence 
of dimensions (dim(A n ^))o<j<n and denote by < o§ < o\ < ■ ■ ■ < a m < n the 
positions where the "jumps" occur, that is, dim( A r\Fj) = i for Oi < j < a; L+ \ (using 
the conventions dim0 = —1 and <r_i := 0, a m+ \ := n). The sequence (ai) can be 
encoded by the sequence of integers n — m > X\ > X2 > ■ ■ ■ > A m+ i > defined by 
Aj + i := n — m + i — <jj. 

Generally, a partition A = (Ai, . . . , A r ) is a weakly decreasing sequence of natural 
numbers. The length of A is defined as the number of nonzero components of A. 
The size of A is defined as |A| := Ai + • • • + A r , and we call A a partition of k, if 
|A| = k. We say that a partition contains a partition A, A C fj,, if Aj < in for all i 
(we set Aj = for all i exceeding the length of A). 

To a partition A of length at most m + 1 with Ai < n — m (in which case we call 
A admissible) we associate a strictly increasing sequence < o"o < • • • < a m < n by 
setting <7j := n — m + i — Aj+i for < i < m. The o"j are used to select a subflag 
Ffj Q C . . . C F CTm with dim F ai = ai . For such a partition A and a flag F € T the 
Schubert variety Q\(F) is defined as follows: 



For A e G(m, n) we always have dim(^4 n F ai ) > i — Aj + i, so that Aj+i measures 
the excess in dimension of the intersection. It is known that Q\(F_) is an irreducible 
variety of codimension |A| in G(m,n) 20, III. 9. 4]. (Note that since A is admissible, 
we have |A| < dimG(m, n).) In general, Schubert varieties are singular |37l §3.4]. 

For a flag F_£ T and an admissible partition A the Schubert cell e\ (F_) is defined 
as follows (put F_i = 0) 



Thus e\ (F_) consists of those elements A € £1\ (F_) for which dim A n Fa increases at 
exactly the positions j = ai. The Grassmann variety G(m, n) is the disjoint union 
of the Schubert cells e\(F_) over all admissible partitions A. Moreover, it is known 
that 



G(m, n) := {A | A C P n linear subspace of dimension m} 



tt\(F) := {A G G(m, n) \ &im.(A n F Ci ) > i for < i < m}. 



e\(F) := {A G n x (F) \ dim(A n = i - 1 for < i < m}. 



(1) 




(2) 



AC/i 



5 



where the union is over all admissible partitions fi containing A, cf. |2Ul III. 9. 4, 
Ex. 13] or |37l §3.2]. The Schubert cell is a complex analytic submanifold of G(m, n) 
of codimension |A|. It is open and dense in Q\(F). Moreover, e\(F_) is contained in 
the smooth part of Q\{F), cf. |SZl §3.4]. 

Example 2.3 (i) In the case A = (k) = (k, 0, . . . , 0) the degeneracy conditions 
reduce to the single condition A n F ao ^ on F ao G G(n — m — k,n). 

(ii) In the case A = (l fc ) = (1,...,1,0, ...,0) the de generacy conditions reduce to 
the single condition dim(j4 n F (7k _ 1 ) > k — 1 on F CTk _ 1 G G(n — m + k — 2, n). 

(iii) We have P n = G(0, n) = n (F) = U™ =0 e (i) , where e (i) =F { - ^ C\ which 
is just the usual decomposition of P n as a disjoint union of affine spaces. 

Let V C P n be a smooth projective variety of pure dimension m. The Gauss map 
ip: V — > G(m,n) maps x G V to the projective tangent space T X V C ¥ n at x. For 
an admissible partition A and a flag Fe fwe define the generalized polar variety 

P\{F) := </> -1 (0 A (F)) = {x G F | dim(T x V n F^) > i for < * < m} (3) 

to be the preimage of the Schubert variety £l\(F) under the Gauss map. The well- 
known polar varieties 

Pk{F) := P m (F) = {x G V | dim(T x V n F n _ m+fc _ 2 ) > fc - 1} 

correspond to the special case A = (l fc ) = (1,... ,1,0,... ,0), see 03110]. We remark 
that a different concept of generalized polar varieties has been previously used for 
algorithmic purposes, see [UEI]. 

Note that the case where V is a linear space is degenerate: then dim (p(V) = 
and thus P\(F_) is empty for almost all F G provided |A| > 0. A result by Zak, 
cf. |23| §7], states that this is the only degenerate case. Namely, if V Q P n is a 
nonlinear irreducible smooth projective variety, then the Gauss map ip: V — > <p(V) 
is finite. In particular, we have dimip(V) = dimy in this case. 

We recall now the important notion of transversality. For x G V we denote by 
T X V the Zariski tangent space and by d x (p: T X V — * Ttp/ x \G(m,n) the differential 
of ip at x, respectively. The Gauss map tp meets the Schubert cell e\(F_) transversely 
at x G (p ~ 1 (e\(F_)), written (p (h x e\(F_), if 

T v{x) G(m,n) = d x p(T x V) +T v[x) e x (F). 

Moreover, <p meets e\(F_) transversely, written p rti e\(F_), if <p iti x e^^) holds for 
all x in p~ 1 {e\(F_)). 

Remark 2.4 If ip rh e\(F_) then it is well known that p~ 1 (e\(F_)) is a smooth 
complex submanifold of codimension |A| in V, unless it is empty. (Recall that e\(F_) 
has the codimension |A| in G(m,n).) 
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We can extend the notion of transversality to Schubert varieties in the following 
natural way, exploiting their stratification © by Schubert cells. 



Definition 2.5 We say that <p meets £l\(F_) transversely, written (p rh Q\(F_), if for 
every admissible \i 5 A we have ip it) e^(F_). 

The following lemma is proved in Appendix lA.il 

Lemma 2.6 Let V C P n be a smooth projective variety of pure dimension m such 
that not all irreducible components of V are linear. Let ip: V ^ G(m,n) be the 
Gauss map ofV and A be an admissible partition with |A| < m. Then we have 

(i) ip rh £l\(F) for almost all Bags Fe T, 

(ii) if ^ rtl n x (F), then dim(p(V) n e x (F)) = m - |A| and codimyP A (F) = |A|, 

(iii) there exists an integer d\, such that deg P\(F_) = d\, provided ip rh £l\(F). 

We call degPx := c?a the projective character of V corresponding to A. These 
quantities were studied by Severi [IB] , see also [2D Ex. 14.3.3]. Note that the degree 
of V equals the projective character for A = 0. 

Example 2.7 Let V C P 2 be a smooth curve. Then deg Pi counts the number 
of points on the curve whose tangents go through a generic point in P 2 . Bezout's 
theorem implies that this number equals d(d— 1), where d is the degree of the curve. 

The following will be used later. Again, the proof is postponed to the Appendix. 

Lemma 2.8 Let W be a quasiprojective variety and let ip: W — > G(m,n) be a 
morphism. Let A be an admissible partition. For F_ G T set R\(F_) := ip~ 1 (Q\(F_)). 
Then for almost all Fe J- we have &\m.R\{F2) < dimVF — |A| if \X\ < dimW, and 
R\(F_) = otherwise. 

2.3 Expressing the Hilbert polynomial by projective characters 

Our goal is to express the coefficients of the Hilbert polynomial of V in terms of its 
projective characters. We first introduce some notation. 

To any sequence c = (cj)j g N of elements of a commutative ring such that Co = 1 
and to a partition A = (Ai, . . . , A r ) we assign the ring element A^(c) as follows: 




c A!+r-l\ 
C\ 2 +r-2 



(4) 



\CA r -r+l Ca ? .-'-+2 
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using the convention c, = for i < 0. Note that the value of this determinant does 
not change if we extend the partition A by zeros. 

In the following let b be the coefficient sequence of the power series 

gM^^ = i + |+£(-ir^, ( 5) 

where the Bj are the Bernoulli numbers. E.g., B\ = |, B2 = B3 = 

Remark 2.9 It is known that B n = (-l)™" 1 Y%U kTT Er=i(- 1 ) r (r) r " E2- This 
implies that (2n + l)\B n is an integer, hence i\{i + \)\bi is an integer for all i. Taking 
into account that for a partition A = (Ai, . . . , A r ) of size M and length r we always 
have Ai+r-1 < M, we conclude that [(M+l)! • • • (M-r + 2)!] 2 A\(b) is an integer. 

To a pair (A, fj,) of partitions of length at most m we assign the following deter- 
minant of binomial coefficients 



:= det 



Aj + m + 1 — i 
+ m + 1 — j 



l<i,j<rn 



Now let < k < m and \i be a partition with < m — k. To this data we assign 
the rational number 

^ :=( _1)N £ A A (6)^, (6) 

MCA 
|A|=m— fe 

where the sum is over all partitions A of size m — k that contain p as subpartition. 
The following crucial statement will be proved in $0 

Theorem 2.10 Let V C P n be a smooth complex projective variety of pure dimen- 
sion m and < k < m. Then the k-th coefficient Pk{V) of the Hilbert polynomial 
of V is given by 

\fi\<m—k 
fii <n—m 

where deg is the projective character introduced in §2. 21 In particular, [(m — k + 
1)! • • • 2!l!] 2 k\pk(V) is an integer. 

Example 2.11 1. The above formula yields p m (V) = ^ £™' m degPo = deg^, 
as expected (check that A (6) = l,d™o = -0- 

2. In the case where V C P n is a smooth curve (n > 2), the above formula implies 
that po = (5q'° deg Po + 5}'° deg Pi = deg V — \ deg P\ , where deg Pi = #{x € 
V I T^y n L 7^ 0} for a generic linear subspace L C P n of codimension 2. 
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3. In the special case of a smooth planar curve V (see Example 12.7(1 . we have 
Po(y) = d — \d(d — 1) = |d(3 — d), which implies the well known formula 
1 — Po{V) = \{d — \)(d — 2) for the arithmetic genus. 

4. Consider the rational normal curve V C P n , which is defined as the projective 
closure of {(t, t 2 , . . . , t n ) \ t £ C}. The Hilbert polynomial of V satisfies 
Pv(T) = nT + 1. It is not too hard to verify directly that degPi = 2(n — 1). 

3 Counting complexity over the complex numbers 

We will consider BSS-machines over C as they are defined in [HI El- Roughly speak- 
ing, such a machine takes an input from C°°, performs a number of arithmetic 
operations and tests for zero following a finite list of instructions, and halts return- 
ing an element in C°° (or loops forever). The computation of a machine on an input 
x € C°° is well-defined and notions such as a function being computed by a machine 
or a subset of C°° being decided by a machine easily follow. A machine M over C is 
said to work in polynomial time if there is a constant c £ N such that for every input 
x £ C°°, M reaches its output node after at most size(x) c steps. Hereby, we define 
size(x) to be the smallest n > such that x £ C n . The complexity classes Pc and 
NPc are defined as usual, as well as the notions of reduction and completeness. The 
class coNPc consists of all subsets of C°° whose complement lies in NPc. In a com- 
pletely analogous fashion we can also consider machines over R and corresponding 
classes Pr and NPr. 

In |Hj it was shown that the following fundamental problems is NPc-complete. 

HNc (Hilbert's Nullstellensatz) Given a finite set of complex multivariate poly- 
nomials, decide whether these polynomials have a common zero. 

For our convention on coding polynomials as elements of C°° we refer to see also 
[32"1 1.2] for a discussion. 

3.1 Counting complexity classes 

In classical complexity theory, Valiant [inj introduced the counting class #P as the 
class of functions which count the number of accepting paths of nondeterministic 
polynomial time Turing machines. One of his main results 0B] was that the problem 
of counting the number of perfect matchings in a bipartite graph, or equivalently, 
computing the permanent of its adjacency matrix, is #P-complete. For a compre- 
hensive account to counting complexity we refer to [HJ Chapter 18] and [T§] . 

We now recall the definition of counting classes over C from |11[ I13j . which 
follows the lines used in discrete complexity theory to define #P and GapP 19 . 
We denote by Z := ZU {— oo,oo,nil} the union of the set Z with three additional 
symbols — oo,oo, and nil (the latter standing for undefined). For the arithmetic in 
Z, we refer to (TSJ §4.3]. 
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Definition 3.1 (i) A function p: C°° — > N U {00} belongs to the class #P C if 
there exists a polynomial time machine M and a polynomial p such that 
ip(x) = \{y G C p(n) I M accepts (x,y)}\ holds for all x G C n and all n G N. 

(ii) The class GAPc consists of all functions 7 : C°° — > Z of the form 7 = 99 — ip for 
^ G #P C . 

We next define notions of reduction and completeness for counting classes. 

Definition 3.2 1. Let ip,ip: C°° -> Z. We say that vr : C°° -> C°° is a parsimo- 
nious reduction from to ^ if 7T can be computed in polynomial time and, for 
all x G C°°, 92(2;) = Tp(ir(x)). 

2. Let 99, if): C°° — > C°°. We say that <p Turing reduces to ip if there exists an 
oracle machine which, with oracle ip, computes tp in polynomial time. 

Let C be either #Pc, or GAPc- We say that a function ip is hard for C if for every 
if G C there is a parsimonious reduction from ip to ip. We say that ip is C- complete 
if in addition ip £ C. The notions of Turing-hardness and Turing- completeness are 
defined similarly. 

In |llj it was shown that the following basic problem is #P c -complete with 
respect to parsimonious reductions. 

#HNc (Algebraic point counting) Given a finite set of complex multivariate poly- 
nomials, count the number of complex common zeros, returning 00 if this 
number is not finite. 

In an analogous fashion, the problem AHNc (as introduced in |13l §4.3]), which 
counts the difference in the the number of solutions of two given systems of polyno- 
mial equations, is seen to be complete for the class GAPc- 

There are algorithms solving #HNc in single exponential time (or even parallel 
polynomial time). A key point for showing this is the fact that a Grobner basis of 
a zero-dimensional ideal can be computed in single exponential time |18 [ I34[ 135]. 
The number of solutions can then be determined using linear algebra techniques, as 
described for example in |16| Chapter 2]. 

We remark that a corresponding counting class #Pk over the reals has been 
introduced by Meer [20] an d was further explored in jllj . 

3.2 Polynomial hierarchy over the reals 

The constant-free polynomial hierarchy over the reals will be needed in the next 
section for extending the notion of a parsimonious reduction. It is important to 
work over the reals since the polynomial hierarchy over the complex numbers has 
not enough expressive power for our purposes. 

For what follows, we call a machine (over M. or C) constant-free, if its only 
machine constants are and 1. The following definition is from Chapter 21]. 
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Definition 3.3 A relation R C R°° is said to be in for k G N, if there exists a 
relation A C (R°°) fc+1 , decidable in polynomial time by a constant-free machine M 
over M, and polynomials Pi, ■ ■ ■ ,Pk, such that for x G R n : 

where Q± = 3 and the quantifiers Qi G {3, V} alternate. We define the constant-free 
polynomial hierarchy PH^ to be the union PHjj = U^S^. 

We next observe that the dimension and local dimension of semialgebraic sets 
can be expressed in PH^. We study this in the general situation of a family of 
semialgebraic sets S u depending on a parameter u G R°° such that the property 
x G S u is expressible in PH^. We denote by dim x S u the local dimension of S u 
at x G S u (defined to be —1 if x g" S u ). 

Lemma 3.4 Let R C R°° x R°° be a relation in PHjj, p be a polynomial, and 
consider for u G R n the semialgebraic set S u := {x G R p( - n ) [ (u, x) G i?}. Then both 
decision problems {(u, d) G R°° x N | dimS u > d} and {(u, x, d) G R°° x R°° x N | 
dim^ S u > c?} are in PH^ . 

Proof. We have dimS'u > d if and only if there exists a (i-dimensional coordinate 
subspace such that the projection of S u on this subspace has a nonempty interior. 
Writing this condition as a first order formula over R yields the claim for the di- 
mension. (For a more economic description, see |33|.) 

Let B e (x) denote the open ball with radius e centered at x. We have dim x S u > d 
if and only if dim(S' u D B e (x)) > d for sufficiently small e > 0, cf. @]. Writing this 
as a first order formula over R implies the claim about the local dimension. □ 

3.3 Generic parsimonious reductions 

The concept of generic parsimonious reduction, as introduced in jTH] and implicit in 
jllj . allows to make "general position" arguments as part of a reduction algorithm. 
A paradigmatic example is that of reducing the problem of computing the geometric 
degree of a variety V to HNc by intersecting V with a generic linear subspace of 
complementary dimension. We are interested in problems where it is possible to 
compute in polynomial time a list of candidates for generic parameters, among 
which the majority is in fact "generic" (see the notion of partial witness sequences 
introduced in jllj). This can be achieved by only requiring the genericity condition 
to be describable in terms of the constant-free polynomial hierarchy over the reals. 

In the following, we are concerned with relations R C C°° x C°°. It makes sense 
to say that such a relation is in PH^ by representing points in C n as points in R 2n 
in the obvious way. 

We call a relation R C C°° x C°° balanced if there is a polynomial p such that 
R(u,a) implies size(a) < p(size(u)) for all (u,a) G C°° x C°°. In this case we say 



11 



that p is associated to R. Moreover, we will write V*a G C™ R(a) in order to express 
that Zariski almost all points a G C n satisfy a relation R. 

Definition 3.5 Let (p, tp: C°° — > Z. A generic parsimonious reduction from tp to ip 
consists of a pair (ir,R), where tt: C°° x C°° — > C°° is computable in polynomial 
time over C by a constant-free machine, and i? C C°° x C°° is a balanced relation 
(with associated polynomial p) in PHjj such that for all m G N the following holds: 

(i) Vu G C m Va G C p( - m ^ (R{u,a) => p(u) = V(^(n,a))), 

(ii) Vu G C m V*a G C p ( m ) H(u,a). 

We write (p ^ if there exists a generic parsimonious reduction from <p to tp. 
In ^3] it was shown that this is a transitive relation. The following important fact 
is shown in |13[ Theorem 4.4]. 

Theorem 3.6 Let cp, ip : C°° — > Z. If ip ^ ip then ip Turing reduces to ip . 

The closures of #Pc and Gapc with respect to generic parsimonious reductions 
defined below seem to capture more accurately the kind of counting problems en- 
countered in algebraic geometry. 

Definition 3.7 (i) The class consists of all functions ip: C°° — > NU{oo} such 
that there exists ifi G #Pc with (p :<* ijj. 

(ii) The class Gap^ consists of all functions ip: C°° — ► Z such that there exists 
if) G Gapc with <p :<* V- 

The functions in Gap^ can also be characterized as the differences of two functions 
in #P C *. 

Similar as GapP (cf. JH]), the class GAPji is closed under exponential summation. 

Lemma 3.8 Let ip: C°° x {0, 1}°° — > Z be a function in GAPji, q be a polynomial, 
and g: {0, 1}°° -> Z be in GapP. Define C°° -> Z by setting for « G C m 

ye{0,l}9( m ) 

Then 92 belongs to Gap^. A similar statement holds for Gapc- 

Proof. The function C°° x {0, 1}°° — > Z, (u, y) \— * g(y)(p(u,y) is in Gap^ since the 
product of two finite valued functions in GAPj? is in GaPj? |131 Lemma 4.9]. The claim 
now follows from the fact that Gap^ is closed under exponential summation |131 
Lemma 4.10]. □ 
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In jllj the problem of computing the geometric degree of the zero set Z C C" 
of given complex polynomials was Turing reduced to HNc . An analysis of the proof 
reveals that this reduction is generic parsimonious except for the computation of 
the dimension of Z at the beginning. Therefore, the following slight modification of 
the degree problem is in #P^: given Z as above and d G N such that d\mZ < d, 
compute the geometric degree of the d-dimensional part of Z. 

We can even extend this to the situation, where Z u C C n is a constructible set 
depending on a complex parameter vector u and membership of x in Z u can be 
decided by a polynomial time machine. (By the degree of a constructible set we 
understand the sum of the degrees of its components of maximal dimension.) 

Lemma 3.9 Let M be a polynomial time machine over C, p: N — > N be a polyno- 
mial and consider for u G C n the constructible set 

Z u := {x G C p{n) | M accepts (u,x)}. 

Then there is a function ip in #B£ such that for all u G C°°, d G N the value ip(u, d) 
equals the degree of the d-dimensional part of Z u , provided dimZ u < d. 

Proof. The proof is completely analogous to the case where Z u is given as the zero 
set of polynomials see also j!2l Theorem 7.2]. □ 

Example 3.10 Let F be a matrix with entries in C[Xi, . . . , X n ], k, d G N such that 
Z := {x G C n | rankF(x) < k} has dimension at most d. Then, by Lemma 13.91 
the degree of Z can be computed in ^P^. This follows since the rank condition 
can be tested in polynomial time using linear algebra. (However, writing down the 
rank condition in terms of non- vanishing of minors would lead to a representation 
of exponential size.) 

3.4 Boolean parts 

If L is one of the computational problems studied in this paper, we denote by L z its 
restriction to input polynomials with integer coefficients. These discrete problems 
will be studied in the Turing model of computation. For doing so, we introduce the 
notion of the Boolean part of a complexity class over C. For more details on the 
following we refer to |111 113j . 

Let C be a class of functions C°° — ► Z. We define its Boolean part BP(C) as 
the class of functions {0, 1}°° — > Z obtained from functions in C by restriction to 
{0, 1}°°. In the class GCC of geometric counting complex problems was defined 
as the Boolean part of #Pc- The discrete version #HN^ of the problem #HNc is 
GCC-complete Both GCC and the Boolean part BP(Gap^) are closed under 

parsimonious reductions and (cf. [T3] ) 

#P C GCC C BP(Gap^) C FPSPACE. 
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The class BP(GAPj?) is closely related to GCC in the sense that any ip G BP(GAP£) 
can be parsimoniously reduced to AHNc in a randomized sense, cf. [ TBI Remark 6.7]. 
It is a challenging open problem to characterize GCC and BP(Gap^) in terms of 
previously studied classical complexity classes. 

4 Complexity of computing the Hilbert polynomial 

Our goal is to show that the problem of computing the Hilbert polynomial of a 
smooth equidimensional projective variety lies in the class Gap^. When trying to 
formally define the problem under consideration, the question arises whether the 
smoothness condition can be tested at all within these resources. The obvious idea 
of checking the Jacobian criterion at all points in the variety V (which is possible in 
coNPc) will fail if the given polynomials fx, . . . , f r describing the variety V do not 
generate a radical ideal and thus differ from the vanishing ideal J(V) of V . Indeed, 
it is not known whether a set of generators of /(V) can be computed from fi, ■ ■ ■ , f r 
in parallel polynomial time or even weaker, in single exponential time. 

We overcome these difficulties by requiring an input specification, which, on the 
one hand, can be checked in coNPc, and on the other hand guarantees that the 
highest dimensional part of the variety is smooth. The goal is then to compute the 
Hilbert polynomial of the highest dimensional part. 

Thus in the following, we will assume that the projective variety V C P n is given 
as the zero set of a family f\, . . . , f r of homogeneous polynomials in C[Xo, . . . , X n ] 
satisfying the following input condition: 

Vx G Z(h, f r )-{0} dim{z G C n+1 | d x h{z) = 0, . . . , d x f r (z) = 0} < m+l (7) 

for some m G N. Here and in the following, we assume that the given poly- 
nomials / are encoded as strings in C°° using the sparse encoding. Thus / = 
^2 eG i a e XQ° ■ ■ ■ X^ n is represented by a list of pairs (a e , e), where the coefficients a e 
are given as complex numbers, while the exponent vector e is given by a bit vector 
of length at most 0{n log deg / ). 

We remark that the input condition (J7J) can be tested in coNPc. 

Lemma 4.1 Assume that the input condition J3) is satisfied. Then V' = VUW is a 
disjoint union of a smooth variety FCT of pure dimension m (possibly empty) and 
a subvariety W C P n with dimH^ < m. In particular, the irreducible components of 
the m-dimensional part V of V are pairwise disjoint. A point x G V is in V if and 
only if dim-z V' = m. Moreover, n — m < r and for all x G V the Jacobian matrix 
(t^(x)) has rank n — m. 

Proof. For all x €V' we have T X V' C P(n[ =1 ker d x fi), where T X V' is the projective 
tangent space of V at x. The input condition implies that for all x G V, dim x V < 
dimT^V < m holds. Therefore, all points x G V of local dimension m are smooth. 
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The first claim follows since there is exactly one irreducible component passing 
through a smooth point. The remaining claims are clear. □ 



We give now a formal definition of our main problem under investigation. In 
order to make sure that the output is an integer, we require to compute a certain 
multiple of the k-th. coefficient of the Hilbert polynomial. 

HlLBERT sm (Hilbert polynomial of smooth equidimensional varieties) Given inte- 
gers < k < m < n and a family fi, ■ ■ ■ , f r of homogeneous polynomials in 
C[Xq, . . . ,X n ] satisfying the input condition for m, compute the integer mul- 
tiple N(k,m) Pk{V) of the fe-th coefficient Pk(V) of the Hilbert polynomial of 
the m-dimensional part V of V, where N(k,m) := [(m — k + 1)! • • • 2!1!] 2 . 

Here is the main result of this article. 

Theorem 4.2 The problem HlLBERT sm is in Gap^. In particular, the problem 
HiLBERT sm Turing reduces (over C) to HNc- 

This theorem immediately implies the following corollary, cf. Section fo. 41 Recall 
that HiLBERT^ m denotes the restriction of HiLBERT sm to input polynomials with 
integer coefficients. 

Corollary 4.3 The problem HlLBERTjf m is in BP(GAP^). In particular, theproblem 
HiLBERT^ m Turing reduces to HN^ (in the sense of classical Turing machines). 

4.1 Upper bounds 

The upper bound on HiLBERT sm is based on Theorem l2.1()l We therefore first study 
the problem to compute projective characters (recall Lemma [2 .61 for their definition). 

ProjChar (Projective characters) Given < m < n, homogeneous polynomials 
/i, . . . , f r in C[Xq, . . . , X n ] satisfying the input condition for m and a partition 
A such that Ai < n — m and |A| < m, compute the projective character deg P\ 
of the m-dimensional part V of V' = Z(fi, . . . , f r ). 

Proposition 4.4 The problem ProjChar is in #P^. 

Using this proposition, we can immediately proceed to prove the main Theo- 
rem E21 

Proof of Theorem Put N(k,m) := [(m - k + 1)! • • • 2!1!] 2 . Consider the 

function g: {0,1}°° — > Z mapping (m,k,p) to N(k,m)5™ ,k , where m,k E N, fi 
a partition with \fi\ < m — k, p,\ < n — m and 8™ ,k is defined in Equation ©, i.e., 
$™' ■= (— Ylficx |A|=m-fc ^-^(fyd™^. By Remark [231 the values of g are integers. 
The functions mapping (m,k,fi,X) to A\(b)d™ and to N(k,m), respectively, are 
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clearly polynomial time computable, if we think of (m, k, fx) as being encoded in 
unary. It then follows from elementary properties of GapP (closure under exponential 
summation and product, cf. [19]) that g is in GapP. Let <p: C°° x {0,1}°° — » Z U 
{— 00,00} be the function corresponding to the problem ProjChar, where the 
first argument contains the description of the polynomials and the second argument 
the partition A. According to Proposition 14.41 <p G #Pc, so we can apply the 
Summation Lemma 13.81 to the main formula in Theorem I2.1UI to conclude that 
HlLBERT sm G GAPji. □ 

We prove Proposition ^. 4l using a generic parsimonious reduction from ProjChar 
to a certain auxiliary problem, which we describe next. Consider an instance of 
ProjChar. Write ip(x) := F(f|[ = i ker d x f\) for x G V and define for a flag FeT 
the following constructible set (recall that <jj = n — m + i — Aj+i) 

Q\{E_) := {x G V I dim(i/>(x) n F ai ) > i for < i < m}. (8) 

We will represent a flag F_ G T by a matrix a G C nx ( n+1 ) such that i* 1 ^ is the 
projective zero set of the linear forms corresponding to the first 5{ := n — o~i = 
m — i + Aj+i rows of a, for < i < m. 

Lemma 4.5 There is a function $ in #P^ which takes as input an instance of 
ProjChar and a hag F G T and outputs the degree of the (m — |A| ) -dimensional 
part of Q\(F_), provided dimQ^^) <m — \X\. 

Proof. Suppose we have an instance of ProjChar and a flag Fef given by the 
matrix a G C" x ( n+1 ). Let Mi(x,a) G C^' + ^ x( - n+ ^ denote the matrix obtained by 
taking the submatrix of a consisting of the first 5i rows of a and adding the Jacobian 
matrix (df s /dXj(x))i< s < r fi<j< n at the bottom. Then we have for all x 

dim(-0(x) fl F ai ) > i <^=^> rankMj(x, a) < n — i. 

This condition can be tested in Pc, since the rank of a matrix can be computed 
in polynomial time, e.g., using Gaussian elimination (compare Example I3.10j) . The 
claim follows now from Lemma 13.91 □ 

Proof of Proposition \4-4\ Suppose we are given an instance of ProjChar. Let 
V>(x) = P(f|[ = iker4./i) and Q\(F) be defined for a flag F G T as in ©. By the 
input condition Q, ifj(x) is a linear subspace of P n of dimension at most m for every 
x G V. Let V = V U W be as in Lemma 14. II so that V is smooth of dimension m 
and dimp^ < m. We then have ip(x) = T X V for all x G V, so that the restriction 
(p := ip\v determines the Gauss map cp: V — > G(m,n). Note that ip(x) may be 
different from the projective tangent space at points x G W. 

Set P X {F) :=Qx(F)nV and R X (F) :=Q\(F)nW. Then P X (F) is the gener- 
alized polar variety introduced in (j3J) and we have Q\(F_) = P\(F_) U R\(F_). 
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Consider the following property of an instance I of ProjChar and a flag F G T: 

if rtl n x (F) and dimi? A (F) < m - |A|. (n) 

According to Lemma l2.6l the condition cp rtl Q\(F_) implies that dim P\(F_) = m— |A| 
and degPx^) = degP A > under the assumption that not all components of V are 
linear, or A = 0. (If the latter assumption is violated, then P\(F_) = 0.) We therefore 
get 

II is satisfied degP A = degP A (F) = 

where $ is the function from Lemma f4.5| i.e., the degree of the (m— |A|)-dimensional 
part of Q\(F_). This establishes a generic parsimonious reduction from ProjChar 
to the function <3? G #P<c, once we have shown that II is definable in the constant- 
free polynomial hierarchy over M and that for any fixed instance / of ProjChar, 
property II is satisfied by almost all F G T (cf. Definition 13. 5j) . 

Lemma 12.61 tells us that (p rtl £l\ (F_) is satisfied for almost all F_£ T. In order to 
show that dim R\(F_) < m— |A| for almost all F_, we apply Lemma f2.8l to the quasipro- 
jective set Wj := {x G W | dim^(x) = j} and the map ipj : Wj — > G(j, n), x i— > tp(x), 
for < j < m. It is not hard to identify the set 

Rj,\(F) ■={xeW j \ dim(V>(x) n F Vi ) > i for < % < m} 

as the preimage of the Schubert variety corresponding to the flag F_ and to a partition 
fj,^ satisfying \fiv)\ > |A|. Thus Rj t \(F_) has dimension dim — \fi\ < dim Wj — |A| 
for almost all F_. Since W = Wq U • • • U W m and dim W < m we have R\(F) = 
Ro,\(F) U • • • U R m ,\(F), and conclude that indeed dim_R A (F) < m — |A|. 

It remains to be seen that II can be defined in PHjj. According to Definition 12 .51 
(f rtl Q\(F_) can be expressed as follows: 

V/x (fi 5 A A fx admissible </3 rtl e^(F)), (9) 

where the transversality condition 99 rtl e^(F) means that 

Vx (x G V A i^(x) G e^F) =► y> rtl z e M (F)). 

Lemma lA.31 in Appendix IA.2I savs that the local transversality condition in the 
parenthesis is decidable in P^. This implies that condition is expressible in 
coNP^ and thus in PH^. 

In order to express dim R\(F_) < m — |A|, we recall that the points x G W can 
be characterized among the points of V as those having local dimension smaller 
than m, cf. Lemma 14.11 The local dimension of (semi) algebraic sets is expressible 
in the constant-free polynomial hierarchy over the reals (compare Lemma l3.4[) . We 
can thus express membership to R\(F_) in PHj$. Finally, using Lemma 13.41 again . we 
conclude that the condition dim R\(F_) < m — |A| is expressible in PH^. □ 
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4.2 Lower bounds 



We first complement the upper bound in Corollary 14.31 bv a lower bound. 
Proposition 4.6 The problem HiLBERT^ m is #P-hard. 

Proof. We proceed as in [Q . Let <p be a Boolean formula in the variables X\ , . . . , X n 
in conjunctive normal form. It is well known that the problem ^SAT to count the 
number of satisfying assignments of such formulas is #P-complete |491 148j . 

For each literal A put g\ := 1 — Xi if A = Xi and g\ := Xi if A is the negation 
of Xi. For each clause k = Ai V • • • V Xk put g K := IliLiS'V Let /« denote the 
homogenization of g K with respect to the variable Xq. 

We assign to the Boolean formula 99 = K\ A • • • A k s the system of homogeneous 
equations 

X\ — -Xi-Xq, • • • , X\ — X h Xq, f Kl , . . . , f Ks . 

Clearly, the zero set V of this system in P n corresponds bijectively to the satisfying 
assignments of ip (there are no solutions at infinity). Moreover, looking at the first 
n equations we see that the input condition (0) is satisfied with m = 0. The Hilbert 
polynomial of V is constant and equals the number of satisfying assignments of ip. 
This provides a polynomial time reduction from #SAT to HiLBERT^ m . □ 

Remark 4.7 Due to the input condition Q it is not clear whether HiLBERT sm and 
HiLBERT^ m are ^P c -hard and GCC-hard, respectively. 

Corollary 14.31 states that the problem HiLBERT^ m to compute the Hilbert poly- 
nomial of smooth varieties is in BP(GAP£). We next show that the general problem 
to compute the Hilbert polynomial of a homogeneous ideal is presumably more 
difficult, namely FPSPACE-hard. Consider the following problems: 

HIM [Homogeneous ideal membership problem) Given non-constant homogeneous 
polynomials /1, . . . , f r ,g S C[Xq, . . . , X n ], decide whether g lies in the ideal 
generated by fx, . . . ,f r . 

Hilbert (Hilbert polynomial) Given a family of non-constant homogeneous poly- 
nomials /i,...,/ r in C[Xo, . . . , X n ] and < k < n, compute the A;-th co- 
efficient of the Hilbert polynomial of the homogeneous ideal generated by 
Hi-- - 1 fr- 

We will use the following simple and well-known lemma to establish a Turing 
reduction from HIM Z to Hilbert z , and then invoke a result in Mayr [SHI Thm. 17], 
which states that HIM Z is PSPACE-complete. 

Lemma 4.8 Let I be a homogeneous ideal such that some Xi is not a zero-divisor 
of C[Xq, . . . , X n ]/I. Let g be a non-constant homogeneous polynomial. Then g E I 
if and only if I and I + (g) have the same Hilbert polynomial. 
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Proof. Assume Xi is not a zero-divisor of C[Xo, . . . , X n ]/I. Let I, g be such that 
J := I + (g) and I have the same Hilbert polynomial. This means that jW) = jW 
for sufficiently large degree d. Hence, we have Xfg E / for sufficiently large d, and 
thus gEl. □ 

By introducing a further variable Y we can achieve that Y is not a zero-divisor 
of C[Xq, . . . , X n , Y]/I, where I = C[Xq, . . . , X n , Y]I. Hence we obtain the following 
lower bound. 

Theorem 4.9 The problem Hilbert z is FPSPACE-hard. 

Based on this theorem, we can now improve the #P-lower bound in for 
the problem to compute the ranks of cohomology groups of coherent sheaves on 
projective space. The lower bound is also true for the problem to compute the 
corresponding Euler characteristic. 

For an introduction to sheaf cohomology we refer to |26l I29j . We encode the 
input to our problems as in pQ. Thus we specify a coherent sheaf on P™ by giving 
a graded matrix. This is a matrix (pij)i<i< s i<j<r of homogeneous polynomials in 
S := C[Xq, ■ ■ ■ , X n ] together with two arrays of integers [d\, ■ ■ ■ , d s ) and (ei, . . . , e r ) 
such that deg pi j = d{ — ej whenever pij ^0. A graded matrix defines a degree- 
preserving morphism 

3=1 i=l 

of graded 5-modules. (As usual, S(d) denotes S with degrees shifted by d to the 
left, so that S(d)o = Sd-) The cokernel M of 7 is a finitely generated, graded S- 
module and thus determines a coherent sheaf M on P n (cf. |261 p. 116]). We study 
the task to compute the dimensions of the cohomology C- vector spaces H l (¥ n ,M) 
for i = 0, . . . , n. (It is known that these vector spaces vanish for i > n 26, III. 2. 7].) 
The Euler characteristic of the sheaf M is defined as 

n 

X{M) := ^(-l) i dim H\¥ n , M). (10) 
i=0 

The link to the Hilbert polynomial is given by the following proposition, a proof of 
which can be found in [29', Section 7.6], see also 1261 Ex. III. 5. 2]. 

Proposition 4.10 Let I C S := C[Xq 3 . . . , X n ] be a homogeneous ideal, M = S/I 
and Pm(T) € Q.[T] the corresponding Hilbert polynomial. Then (d) = x(M(d)) 
for all deZ. 

We now consider the following problems. 

RankSheaf (Rank of sheaf cohomology) Given a morphism 7 by a graded matrix 
as above and given i£N, compute dim H l (¥ n ,M) for M = coker7. 
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EulerSheaf (Euler characteristic of sheaf cohomology) Given a morphism 7 by 
a graded matrix as above, compute x(M) for M = coker7. 

The following result improves the #P-lower bound in PQ. 

Corollary 4.11 The problems RankSheaf 2 and EulerSheaf z are FPSPACE- 
hard. 

Proof Clearly, EulerSheaf z can be Turing reduced to RankSheaf z . The- 
orem 14.91 tells us that Hilbert z is FPSPACE-hard. It is therefore sufficient to 
establish a Turing reduction from Hilbert z to EulerSheaf 2 . 

An instance of Hilbert z is a family of non-constant homogeneous polynomials 
/l,...,/ r in Z[Xq, . . . , X n ]. Let I denote the corresponding homogeneous ideal 
in C[Xq, . . . , X n ]. Consider the graded morphism 7: ©J =1 S(ej) — > S given by 
fl, . . . , f r , where ej := — deg fj. The cokernel M of 7 equals S/I. 

By Proposition 14. ldl we have PM(d) = x{M(d)) for all dgZ. We can therefore 
obtain the values pu{d) for d = 0, . . . , n by n + 1 calls to EulerSheaf 2 and then 
compute the coefficients of pm by interpolation. □ 

Remark 4.12 The algorithm in 6 combined with the upper bounds in |38J implies 
that Hilbert 2 is in FEXPSPACE. We do not know of any better upper bound on 
this problem. The known algorithms for sheaf cohomology (cf. |5U1 Chapter 8], |17j ) 
suggest that RankSheaf z is in FEXPSPACE. 

5 Hilbert polynomial and degeneracy loci 

This section is devoted to the proof of Theorem I2.1UI 
5.1 Chern classes and Riemann-Roch 

References for the material presented here are |151 1271 I41j . See also |21| for the 
algebraic geometry perspective. Let V be a variety (recall the conventions made 
for varieties at the beginning of 53). Chern classes are characteristic cohomology 
classes Ci(E) £ H 2l (V) associated to a complex vector bundle p: E — > V . Chern 
classes are characterized axiomatically as follows: 

1. a(E) G H 2i (V), c (E) = 1 and cy{&) generates H 2 (P n ), where Jgf is the 
canonical line bundle on P n . 

2. Let f:W — * V be a morphism of projective varieties. Then Ci{f*{E)) = 
f*(ci(E)), where f*(E) denotes the pull-back bundle with respect to /. 

3. (Whitney formula.) An exact sequence of bundles — > E' — > E — > E" — * 0, 
implies Cf.[E) = Y2i c i(E') ^ Ck-i(E"), where ^ denotes the cup-product. 
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The total Chern class is the sum c{E) = X^i>o c »(-^') ^ H*(V) of all the Chern 
classes. If V is smooth and irreducible of dimension m, then the top Chern class 
c m (TV) of the tangent bundle evaluated at the fundamental class yields the topo- 
logical Euler characteristic of V: 

X (V) = deg(c m (TV)~[V]), 

see page 170]. Here ^ denotes the cap-product and deg: H (V) — ► Z is defined 

by deg(J2 P n p[p}) = J2 P n P - 

We now introduce the necessary terminology needed to state the Hirzebruch- 
Riemann-Roch theorem, which relates the Chern classes to the Hilbert polynomial. 

Let f(t) = € Q[[tj] be the formal power series (JSJ) and ti,...,t n different 

variables. Consider the product 

oo 

f(h)---f(t n )=J2g i (ti,...,t n ), 

j=0 

where the gi are the i-th graded parts. The gi are symmetric polynomials in the ti, so 
there is an expression g n {t\, . . . , t n ) = T n (ai, . . . , a n ), where Oi is the i-th elementary 
symmetric function in the ti. The T n G Q[^i, • • • , X n ] are called Todd polynomials. 
Note that T n is homogeneous of weight n, when we define the weight of a monomial 
X[ x ■ ■ ■ X^ 1 to be the sum Yuk=i ^k- For example, the first three Todd polynomials 
are: Ti = \X±, T 2 = ±(Xf + X 2 ), T 3 = ±X X X 2 . 

If c(TV) is the total Chern polynomial of the tangent bundle of a smooth vari- 
ety V of dimension m, then we define the Todd class of V to be 

m 

td(V) :=l + J2 T i(ci,-..,Ci), 

i=l 

where here (and later) we write Cj as shorthand for Ci(TV). 

Consider the sum Yli=i eti = n + Si>i? 5 «(*i' • • • >*n)- Again, the pi are sym- 
metric, so there is a polynomial K n {X\, . . . , X n ) which evaluated at the elementary 
symmetric functions in the ti yields p n . If Ci{E) are the Chern classes of a vector 
bundle £ on a variety V, then the class 

ch(E) :=l + J2Ki(ci(E),...,Ci(E)) 
i>l 

is called the Chern character of E. 

To a variety V C P n and d E Z one can assign the twisted sheaf Oy(d). The 
Chern character of the sheaf Oy{d) is particularly easy to describe. Since Oy(d) 
corresponds to a line bundle, we have only a first Chern class, which is ci{Oy{d)) = 
dc\{J£y). Here, and in what follows, Jzfy denotes the line bundle corresponding to 
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the sheaf Oy(l) and J*fy its dual, i.e., the canonical line bundle on V. For the 
Chern character we get 

ch(CV(d)) = e c ^° v ^ = ^ciW- (11) 

«>o z ' 

To a vector bundle £ona variety V there corresponds a locally free sheaf $ , see 
(471 VI. 1.3] or |26l Ex. II. 5. 18]. Thus we can define the Euler characteristic x(E) 
of E to be the Euler characteristic x{$) = Si( — 1)* d\mH l (V, <f) of $ with respect 
to sheaf cohomology, cf. Equation ijTUjl . 

Lemma 5.1 Let V C P n be a variety and d E Z. Then the Euler characteristic of 
the line bundle Oy{d) equals the Hilbert polynomial ofV evaluated at d, that is, 
x(O v (d))=p v (d). 

Proof. Let z: V — > P n be the inclusion and ^ be a coherent sheaf on V. Then 
£T*(V; &) = H l {¥ n , for all i, cf. pJOl Lemma III.2T0]. If M = S/I denotes the 
homogeneous coordinate ring of V, then i*Ov(d) = M(d), so by Proposition 14.101 
we have x(@v(d)) = Pv(d). □ 

With all these notions introduced, we can formulate the Hirzebruch-Riemann- 
Roch theorem. 

Theorem 5.2 (Hirzebruch-Riemann-Roch, [27]) Let E be a vector bundle on 
an irreducible smooth variety V of dimension m. Then 

X (E) = deg ((ch(£) ~ td(V)) m - [y]) . 

Theorem 15.21 combined with Lemma 15.11 and Equation (|11|) immediately yields 
the following. 

Corollary 5.3 Let V C P n be an irreducible, smooth variety of dimension m. Then 
the k-th coefficient of the Hilbert polynomial of V is given by 

Pk(V) = i deg( Cl (i^) fc - T m _ fc (d, . . . , c m _ fc ) - [y]), 
where ci, . . . , c m are the Chern classes of the tangent bundle TV. 

5.2 Generalities on symmetric functions 

We gather some results from the theory of symmetric functions that will be used 
later. Reference for this material are |36[ I37j . |22| Appendix A] and |21| Appendix 
A.9]. 

For a partition A, we denote by A' its conjugate partition. Recall the definition 
of A\(c) in Equation @. Claims 1 and 2 of the following lemma are easy to verify, 
a proof of the third one is given in |21[ Lemma A. 9. 2]. 
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Lemma 5.4 Let X be a partition and c = {cjjjgN be a sequence of elements of a 
commutative ring such that cq = 1. 

1. The polynomial A A (c) is homogeneous of weight \X\ in the Ci, when Ci has 
weight i. 

2. Let c v = {(-iy Ci } i€N . Then A A (c v ) = (-1)I A I A A (c). 

3. Let c -1 = {c^}j 6 N, where the c' { are the coefficients of the inverse power series 
(E^o^r 1 - Then A^c" 1 ) = A A ,(c v ). 

Example 5.5 We verify claims 2 and 3 of the previous lemma for the special case 
A = For the partition (k) we have A/ k ^(c) = c&. For the partition (l fc ) we have 
Zi(i fe )( c ) = det M k (c), where M k (c) is the Toeplitz matrix 





(c x 


C2 


C3 ' 


• Cfc-l 






1 


ci 


C2 ' 


• C k -2 


Cfc-1 


M k (c) = 





1 


Cl • 


■ C k ~-3 


Cfc-2 




U 





• 


1 





We can expand the determinant as 



det M k (c) = - J2(-iyci det M k -i(c). 



i=l 

This equation coincides with the recursive formula for the coefficients c'j of the in- 
verse power series (Ei>o( — l)* c i) _1 - m particular, we obtain An^c) = det M k (c) = 

Let 7 = (71, . . . , 7 m ) be variables and A be a partition such that | A| <m. Define 
the Schur polynomial associated to A as 



s\(j) ■= s A (7i,...,7 m ) 



det (7/ )i<i,j<m 
det(7 l m ~- 7 )i<ij< m 



(12) 



The polynomial s A (7) is symmetric and homogeneous of degree |A|. Note that s A 
depends not only on the partition A but also on m. 

A proof of the following lemma can be found in |36| 1.3] and |22[ Appendix A]. 

Lemma 5.6 (Giambelli's formula) Let X be a partition with \X\ < m and c = 
{cjjjgN be given such that 

m 

c + cit + • • • + c m t m = JJ(1 + -fit), 

1=1 



i.e., the C{ are elementary symmetric functions in the 7,-. Then A A (c) = sy(^). 
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Example 5.7 If A = (k), then s A (7) is the fe-th complete symmetric polynomial in 
the 7j. This is the sum of all distinct monomials of degree k in the 7j. If A = (l fc ), 
then sa(t) is the A;-th elementary symmetric function in the 7$. 

We will further need a formula expanding the Schur polynomial of a sum of 
variables. The following lemma follows from |21l Example A. 9.1] (see also |361 
Example 1.3.10]). 

Lemma 5.8 Let X be a partition with |A| < m. Then 

s A (7l+A---,7m+l+/3) =^^' AhMs A'(7l ) ---»7m+l), 

where 

dZ = det( )H + m+1 - 
V + m + 1 - 

Example 5.9 Let A = (l k ). Then any subpartition \i C A is of the form (P) for 
some j < k and = (^Zfc+i) • This follows from looking at the coefficients of the 
expansion of S(]fc)(7i + /?,... ,7m+i + using the fact that s^k-, is an elementary 
symmetric function (see Example 15.7(1 . 

5.3 Proof of Theorem IPOl 

In this section we derive Theorem 12. 1UI from Corollary 15.31 in a series of reductions. 
We start by observing a determinantal formula for the Todd polynomials. For what 
follows, we will often write T m (c) as shorthand for T m {c\, . . . , c m ). 

Lemma 5.10 Let b = {6j}igN be the sequence of rational numbers from Equa- 
tion |2J), Co = 1 and let ci, ... ,0m be variables. Then the m-th Todd polynomial is 
given by 

T m (c) = A A ,(&)A A (c), 

\X\=m 

where A = (Ai, . . . , A m ) runs over all partitions of m. 
Proof. Consider the (formal) factorizations 

mm mm 

i +E c ^ = ii( i+ ^ i +E 6 *=ii( i+ ^)- 

1=1 j=i 1=1 j=i 

This amounts to writing the c% and b% as elementary symmetric functions in the 
7j and (3j, respectively. For a partition A of m, let m\(j) be the sum of all dif- 
ferent monomials arising from r y 1 1 ■ • ■ 7^™ by permutation of the 7^ (for example, 
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m (i m )(7) = 7i ' ' ' 7m)- Also, let <ta = cr\ 1 ■ ■ ■ a\ m denote the product of the elemen- 
tary symmetric functions indexed by the partition. By definition, T m (c) is the m-th 
graded component of /(71) • • • /(7m), where f( r yi) = Sj>o^i7i • ^ follows that 



T m {c)= Yj K---h m l\ ■■■in 

ilH h«m=m 

= Yl b Xi ■ ■ ■ b x m m x (j) = Y a \(P) m \(i)- 

|A|=m |A|=m 

By (SE1 I.4(4.2'-3')] we have 

E^(/3)m A (7)= II (!+M= E s a'(/?>a(7), (13) 

A|<m l<i,i<m |A[<m 

where sa is the Schur polynomial of the partition A. Giambelli's formula (Lemma lft.fij) 
expresses the Schur polynomials as determinants: 

s\(j) = A A /(c). 

Noting that degSA(7) = deg m\(^) = |A| and taking the degree m parts in 
completes the proof. □ 

What makes this formula useful is the fact that if c denotes the total Chern class 
of the tangent bundle of a smooth variety, the cohomology classes A\(c) can be put 
in relation to homology classes [P\] of the generalized polar varieties. 

To a smooth variety V C P n of dimension m we can associate a vector bundle 
TV of rank m + 1 such that for all x £ V, T X V = F(T X V). 

The proof of the following proposition uses a result of Kempf and Laksov |301 
Theorem 10], see also |21l Theorem 14.3]. 

Proposition 5.11 Let V C P n be an irreducible, smooth variety of dimension m 
and let X be a partition with |A| < m. Then 



A y (c(TV))~[V] 



'(-1)I A I[P A ] if\i<n-m 
else. 



Proof. Let E be the trivial (n + l)-bundle on V, NV := E/TV and vr : E -> iVV be 
the projection map. Let A be a partition with |A| < m and Ai < n — m. A flag P G T 
determines a partial flag A of trivial subbundles of E with ylj corresponding to F CFi l 
for 1 < j < m. Thus rank(Aj) = o"j_j + 1 = n — m + i — \i. The determinantal locus 

^a(^4;tt) = {2; G V I dim(ker 7r(x) n Ai(ac)) > i, 1 < i < m} 
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studied in |211 Chapter 14] coincides with the generalized polar variety P X (F_). Here, 
by dim(ker ir(x) D Ai(x)) we mean the affine dimension. The statement of 21, 
Theorem 14.3] implies that 

A x (c(NV)) - [V] = [n x (A;7r)} = [P X (F)\, 

provided Q x (A;ir) is of pure codimension |A|. For justifying this, note that in [2*Tj . 
^\{A', 7r ) is interpreted as a subscheme of V and its class is an element of the 
Chow group A*(Q\(A; ir)). However, for generic F € J 7 , the scheme Q x (A;ir) is 
multiplicity- free and of the right codimension, cf. Lemma 12.61 Moreover, there is a 
cycle map A^(Q X (A; n)) — > H*(£l\(A; a)) Chapter 19], which is compatible with 
the action of Chern classes. 

Let s(TV)j= l/c(TV) andJ7V v denote the dual bundle. We have c(NV) = 
s(TV) and c/(7V v ) = (-l)*cj(TV) EH- Using Lemma Ol we thus get 

A x (c(NV)) = A x (s(TV)) = A x ,(c(TV v )) = (-l)\ x \ Ay(c(f V)). 

This shows the assertion in the case \\ < n — m. If Ai > n — m, then since 
NV is an (n — m)-bundle, we have Cj(NV) = for j > X\, which in turn implies 
A x (c(NV)) = 0. This completes the proof. □ 

We now turn attention to the tangent bundle TV. 

Lemma 5.12 Let V C P n be an irreducible, smooth variety of dimension m and 
let X be a partition with |A| < m. For the tangent bundle TV we have 

A x ,(c(TV))~[V) = Yl (-l^df^vp-M ~ [P M ], 

fix <n— m 

where d™^ is defined as in Lemma 15.81 

Proof. It is well known (compare |25| Chapter 16]) that the tangent bundle TV 
of a smooth variety is given by TV = Horn , TV/J£y J . Taking the direct sum 
with the trivial bundle E = Kom(3ty, we get 

TV ®E^ Horn (^,TV/&$ \ ®E^ Ham(JS$, f V) = JSfy ® TV. 
By the Whitney product formula (see <J5. 1|) and the fact that c(E) = 1 we obtain 

c(TV) = c(TV ®E) = c(^ v ® TV). 

Let c{TV) = (1 + 7i) b e the formal factorization and set /3 := ci(j^V). By 

Giambelli's formula (Xemma l5.6j) we have for a partition /z with \u\ < m 

A^(c(fy)) = S/1 ( 7l ,..., 7m+1 ). (14) 
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On the other hand, it is known that (see |2T| Remark 3.2.3b]) 



m+l 



c{^ v ®TV) = 11(1 + 7; + /?). 



i=l 



Using Lemma 15.61 again, we get for any partition A with |A| < m 

A y {c{TV) ) = A A , ( C (J2V ® TV)) = s A ( 7 i + A . . . , 7m+i + /?)• 
By Lemma 15.81 we have 

SA ( 7 1 + A . . ■ , 7m+l + P) = J2 ^ |AhlH ^(7l, ■ ■ ■ , 7m+l)- 

/iCA 

Proposition 15.111 and (|14|) now imply for a partition /j, with < m: 



s^)~[V]=A„,(c(TV))~[V] 
This finishes the proof. 



-l)H[/> t ] for /xi < 



n — m 







else. 



□ 



Example 5.13 Let A = (l k ). Then A A /(c) = c fc (7V), the fc-th Chern class of the 
tangent bundle. By Example 15 . 91 we have d™ = (™Zfc+})> where \i = (l 3 '). Plugging 
this into the formula of Lemma 15.121 we get 



c k (TV)~[V)=J2(-V j 

3=0 



m — j + 1 
m — k + 1 



dW*-^ [p s 



where the [Pj] are the homology classes of the polar varieties. This formula is just 
the known expression for Chern classes in terms of polar classes, see for example 

maun]. 

Proof of Theorem \2.1 (A Assume first that V is irreducible and write c = c(TV). 
We express the Poincare dual of the Todd polynomials in terms of the degeneracy 
loci, using Lemma I5.1UI and Lemma 15.121 

T m _ k (c)~[V}= ]T A A (6)A A /(c) - [V] 

\\\=m—k 

\m—k—\ii\ 



£ A A (6) £ (-l)l""d^ci(jSVr-*- W-[P MJ 



|A|=ro— A; 



/jCA 
/xi <n— m 



|/i|<m— fc 
fii<n~m 



A/t 



M CA 
\|A|=m-fc 



Cl(^V) 



m— fe — |/i 
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(Recall the definition of <5™' fc in Equation ©.) By Corollary 15,31 we obtain for the 
fc-th coefficient Pk(V) of the Hilbert polynomial of V 

Pk(V) = ^ deg ( Cl (^V) fe - T m _ fc (c) ~ [V]) 

= £ ^ fc deg( Cl (^V) m - H -[^]). 

|/i|<m— fc 
/^i <n— m 

Since capping with ci(j£y) m— ^ corresponds to an intersection with a generic linear 
subspace of codimension in V, we have deg (ci(J^V) m_H ~ [^]) = degP M . This 
proves the claim for irreducible V. 

Now let V = V\ U • • • U V s be the decomposition of V into irreducible components 
of the same dimension. Let P^ denote the degeneracy locus of corresponding 
to /i and a generic flag P. Since V is smooth, the Vi are pairwise disjoint and 
P M = P^ U • • • U P*, from which deg P^ = ^ deg P^ follows. On the other hand, the 
Hilbert polynomial is additive on the Vi, which finishes the proof. □ 

Appendix 

A.l Proofs of Lemmas 12.61 and 12.81 

For Lemma 12.61 we need the following result of Kleiman (HJ; see a ls° |26[ III. 10]. 

Lemma A.l Let ip: V —* Y be a morphism of smooth irreducible varieties and let 
X C Y be a quasiprojective smooth subvariety. Assume that Y is a homogeneous 
space, with a connected algebraic group G acting transitively on it. Then for almost 
all g £ G, ip meets gX transversely Moreover, if 5 := dim</3(y)+dimX— dimy > 0, 
then <p(V) n gX is of pure dimension 5, for almost all g £ G. 

Recall that a partition A was named admissible if Ai < n — m and |A| < m + 1. 

Corollary A. 2 Let Z C G(m, n) be a quasiprojective irreducible subvariety and A 
be an admissible partition. Then, for almost all P E T , the intersection Z n f2>(P) 
has codimension |A| in Z if\X\ < dimZ, and it is empty otherwise. 

Proof. Recall from © the cell decomposition £l\(F_) = Uxc^e^F). The Grass- 
mannian G(m, n) is a homogeneous space with respect to the natural action of 
the linear group G := GL(n + 1,C). The group G also acts transitively on the 
flag variety T (in fact, we can define T as a quotient of G, cf. [S3 §3.6]) and we 
have ge\(F_) = e\(gF_). Decompose Z as finite disjoint union of smooth irreducible 
quasiprojective varieties Zj. We can then apply Lemma lA.ll to the inclusion of Zj in 
G(m, n) and to a Schubert cell X := e«(P) in order to obtain that, for almost all P, 
the intersection Zj n e^(P) has the expected dimension (namely dim Zj — \u\ if this 
is nonnegative, otherwise the intersection is empty). This implies the assertion. □ 
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Proof of Lemma Iff. 61 Without lack of generality we may assume that V is irre- 
ducible and not linear. (Note that for linear V, p(V) consists of one point only and 
thus the transversality condition cp rh Q\(F) is equivalent to <p(V) fl tl\(F) = 0, 
except for the trivial case A = (0). We may thus safely ignore linear components 
and restrict attention to a single nonlinear component.) 

In this case, a result of Zak |23l §7] says that the Gauss map ip: V — > G(m, n) is 
finite, hence d\mp{V) = &\m.V = m. Since we are dealing with projective varieties, 
we have d\m(piV) fl Q\(F_)) > dimip(V) + dimQ\(F) — dimG(m, n) = m — |A| for 
any partition A with |A| < m by a standard dimension argument, cf. |25l Thm.17.24]. 

(i) Let /i 2 A be an admissible partition. Lemma I A . 1 1 implies that for almost all 
flags F_ £ J 7 , if meets e^(F_) transversely. Looking at the cell decomposition |2| of 
$l\(F), the claim follows (recall Definition 12 .5|) . 

(ii) We proceed by induction on the size of A. Assume that the claim is true for 
all partitions /i such that |A| < \fi\ < m. Suppose ip (ti £l\(F)- The cell decomposi- 
tion (j2j) of Q\(F_) implies that 

<p(V)nn x (E) = {Jv(v)n efl (F). 

We are going to show that tp(V) intersects the cell e\(F). If this were not the 
case, we had dim((p(V) fl £l\(F)) = max AOj \( m — < m — |A|, since we have 
dim(</?(V) Pi e M (F)) = m — \fj,\ by induction hypothesis. However, this contradicts 
the fact that dim(ip(V) n £l\(F)) >m - |A|. 

Now note that P\(F) = U^^t/? -1 (e,\ (£))■ By Remark EH ^(e^F)) is either 
empty or of codimension m — \fi\ in V. Moreover, we just showed that <^ _1 (e\(F_)) 
is nonempty. This show the induction claim. The induction start where |A| = m is 
proved similarly. 

(hi) We fix a flag F € T and set O := £l\(F ), e := e\(F_ ), de := Q. — e. 
Consider the map 

5: G^N, g ^deg tp-Hgty. 

It is easy to see that the fibers of 5 are constructible. Since G is irreducible, there 
exists a unique integer d\ such that 5(g) = d\ for almost all g G G. We have to 
show that 

Vg € G (ip fti gQ ==> <%) = d A ). 

Fix g' £ G such that 93 rtl </f2 holds and write N := S(g'). By (ii) we know that 
ip~ 1 (g'fl) is of codimension |A| in V. It is sufficient to show that the function 5 is 
constant in a Euclidean neighborhood of g' . 

Let A C P n be a linear subspace of dimension A; := n — m + |A| such that 

Anp- 1 (g'de) = and A rh ^(^e). (15) 

Then the intersection A n ip^ 1 (g'Vt) consists of exactly N elements, say x%, . . . ,xjy, 
cf. (431 §5 A]. It is therefore sufficient to show that for all g in some neighborhood 
of g' condition (|15[) holds with g instead of g' and \A n </3 _1 (gri)| = 2V. 
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Fix a point x%. Since ip~ 1 (g'e) is smooth and of codimension k in P n , it can 
be denned locally around X{ by k equations h\(x, g'), . . . , hk(x, g'). Moreover, these 
equations can be chosen such that hi, ... , h n — m are local equations for V around X{ 
(not depending on g') and /i n _ m+ i, . . . , hy. are obtained by pulling back local equa- 
tions for g'e at the smooth point (p(x). Note that these last |A| equations are 
polynomials in x as well as in the parameter g' . Suppose that A is the zero set of 
linear forms ax, ... , a„_fc. The transversality condition A fr\ x . Lp~ 1 (g'e) implies that 
d x hi(xi,g'), . . . , d x hk(xi, g'),a\, . . . , a„_fc are linearly independent. We are thus in 
the situation of the implicit function theorem: there is a Euclidean neighborhood U 
of g' and a Euclidean neighborhood Vi of Xj such that for each g G U the set 
A n ip~ 1 (gQ) n Vi consists of exactly one point Xi(g). 

It remains to be seen that for g sufficiently close to g' , the set Arap~ 1 (gQ) cannot 
have more than N elements. Suppose by contradiction that there is a sequence g v 
in G converging to g' such that for all i/, An ip~ 1 (g u ^l) contains a point y u different 
from xi(g u ), . . . ,xn(9u)- Since V is compact, by passing to a subsequence, we may 
assume that y v converges to a point y G V. By continuity, y G An ip~ l {g'Q), hence 
y = Xi for some i. We conclude that y u = Xi(g u ) for v sufficiently large, contradicting 
our assumption. □ 

Proof of Lemma \2.8l We may assume without loss of generality that W is irre- 
ducible and that dim-i/ ; ~ 1 (V ; ( a; )) is constant for x € W, say equal to 5. (Decompose 
W into the locally closed subsets W% := {x G W \ dimip~ 1 ^(x)) = i} and apply 
the assertion to the irreducible components of Wj.) By (471 §1.6.3 Thm. 7] (see also 
[251 Thm. 11.12]) we have 

dim W = dim Z + 5, dim R x (F) < dim if)(R x (£)) + 5, 

where we have set Z := ip(W). Assume first that |A| < dimZ. By Corollary IA.21 
we have dim(Z n £l\(F)) = dimZ - |A| for almost all F G T. Since ip(R\(F)) = 
Z n £l\ (F_) , we obtain for almost all F_ 

dimi? A (F) < dim ip(R x {F)) + 5 = dimZ - |A| + 5 = dim W - |A|. 

If |A| > dimZ we have Z n n x (F) = (/) and therefore R X (F) = for almost all F. 
The inequality dim R X (F) > dimW - |A| follows from [23 Thm. 17.24]. □ 

A. 2 Expressing transversality 

In this section we conclude the proof of Proposition 14.41 We consider input data 
of the form (/, n, m, fJ,,F_i %) where / = (/i, . . . , f r ) is a sequence of homogeneous 
polynomials in C[Xq, . . . , X n ] satisfying the input condition (J7J) for m £ N and x is in 
the projective zero set V' of these polynomials. Moreover, F_ is a flag in T encoded 
by a matrix a G <£nx(n+l) an( j ^ _ _ _ _ ,// m+1 ) is an admissible partition with 
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respect to n and m. Recall from Lemma 14. II the decomposition V' = V U W, where 
V is smooth of pure dimension m and dimVF < m. 

Let u G C°° be an encoding of (/, n, m, /x), let a G C°° be an encoding of F_ and 
define the relation trans C C°° x C°° x C°° by 

trans(u, a,x) :<S=^ (x G V A <p(x) G e M (F) => ip &\ x e M (F)), 

where 99 is the Gauss map of V. 

Lemma A. 3 The relation trans is decidable in polynomial time by a constant-free 
machine over C. 

Before going into the proof, we recall some facts concerning the manifold struc- 
ture and cell decomposition of Grassmannians. For a comprehensive account, we 
refer to fH, III.9] and jSZj. 

Dual to our usual encoding a G C nx ( n+1 ) of a flag F G T (where the F% are zero 
sets of row forms of a), we can represent the flag F_ by a basis £ = (£q, . . . ,£ n ) of 
C n+1 such that F{ is spanned by (£q, . . . for < i < n. Clearly, this basis is 
uniquely determined by F up to scaling and can be computed from a in polynomial 
time. 

Let n be an admissible partition and let a denote the associated sequence < 
do < • • • < Cm < n defined by Oi := n — m + i — m+i. To a fixed basis I and \x we 
assign the Schubert cell e M := e M (£) := e M (F) according to Q). (To ease notation, 
we will usually drop the dependence on £.) It is not hard to see that every subspace 
A in e M has a unique basis, that can be represented with respect to the basis I by 
the rows of an (m + 1) x (n + 1) row echelon matrix, which has a 1 at the intersection 
of the i-th row with the <7j-th column, and zeros in the i-th row to the right of this 
position as well as zeros in the erj-th column below this position, for all < i < m. 
In the case m = 3, n = 7, \i = (3, 1, 0), a = (1, 4, 6, 7) such an echelon matrix looks 
as follows: 

/* 1 

* * * 1 

* * * * 1 
* * * 

In order to describe a covering of G(m, n) in terms of affine charts, consider for 
fixed £ the subspaces and L M of C™ +1 spanned by £ ao ,... ,£ CTm and {£j \ j 
{do, . . . , cr m }}, respectively. We define := U^(£) C G(m, n) as the set of {m + 1)- 
dimensional subspaces A C C n+1 whose projection to the subspace L M along L M is 
an isomorphism. The open sets form an open cover of G(m, n). By identifying 
A G Ua with the graph of a linear map from to L^, we get an isomorphism 

a^.U^ Hom^,!,) ^ C (-m)x(m+l) ) 

where the last isomorphism maps an element of Hom(L M , L„) to its matrix repre- 
sentation with respect to the bases defined by £. The matrix a^A) is obtained 






1/ 



(16) 
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from the echelon matrix in by removing all the <Tj-columns (thus removing a 
unit matrix of size m + 1) and transposing. Taking this into account, we see that 
e M C Ufj, and that the image of e M under can be described as follows: 
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M (e M ) = {(ay) G c( n - m ) x ( m+1 ) | ay = for j > ai - i, < i < m, < j < n - m}. 

(18) 

In particular, a fl (e fJ- ) is a linear subspace of C^ n m ) x ( m + 1 ). 

Proof of Lemma \A.,3[ Assume that x G V and <^(x) G e^(£). The claim is that the 
transversality condition 

T^ x )G(m, n) = d x ip(T x V) + T^e^t). (19) 

can be checked in constant-free polynomial time over C. 

In order to simplify notation, we will identify V with its affine cone V, x with 
an affine representative x, and the Gauss map ip with the corresponding morphism 
(p: V — {0} — > G(m,n). This causes no problem, since d x (p(T x V) = d x (p(T x V). 

Given a basis i and a partition fj,, we represent = e^(i) and the tangent spaces 
7A<G(m,n) and T^e^ for A G by means of the chart a M defined in (|17|). Around 
x we extend the Gauss map </3 into the chart considering 

^: /n^u^i/^c^M 

In this light, Equation (|19j) translates into 

C (n-m)x(m+l) = d x ip,j,(T x V) + a M (e M ). 

Equation (JT5|) gives an explicit and simple description of a^e^). It remains to find 
a suitable description of d x ip^(T x V). 

After a linear coordinate transformation, we may assume that = C m+1 x 
and = x <C n_m . Thus without loss of generality, we assume that Aq , . . . , X n 
are coordinates adapted to the decomposition C n+1 = L M © L^. 

Locally around the point x, the variety V Q C" +1 is given as the zero set of the 
polynomials fx,...,f r . Our assumption (f(x) G means that T X V lies in and 
thus in U^. This implies that the matrix (-§^-(x)))i<: s <r,m<t<n has rank n — m. After 
a permutation, we may assume that (^^(x)))i< s <„_ mjm<t < n is invertible. It will be 
convenient to use the abbreviations X' := (Xq, . . . , X m ) and A" := (A m+ i, . . . , A n ). 

By the implicit function theorem there are analytic functions hi, ... , h n _ m in X' 
such that in a neighborhood of x, the variety V is the graph of the analytic function 
h := (h\, . . . , /in-m) defined on a neighborhood of x'. In particular, x = (x', h(x')). 
From this we obtain the following description of the Gauss map: 

^(x'Mx')) = (^-m) g c^^\ 

\OAj / l<s<n— m,0<i<m 
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Hence the vector space d x ^^{T x V) is spanned by the matrices 

d 2 h„ 



(V 1 

J l<s<n—m,0<i<m 

for < j < m. It remains to show that these matrices can be computed in constant- 
free polynomial time over C. We remark that in the case of a hypersurface (m = 
n — 1), this matrix just describes the second fundamental form of V at x. 

By taking the derivative with respect to Xi of f s (X' , h(X')) = 0, we obtain 

y±(X>,h(X>))+ ^{X'MX'))^-{X>) = V (20) 

* t=m+l * 1 

for 1 < s < n — m,0 < i < m. From this, §y~(x') can be computed by inverting the 

matrix (§^;( x ))- By taking the derivative of Equation ()20j) with respect to Xj for 
< j < m we get 

d 2 f s +2 \^ d2 $ s dht + V 5 2 A dh t dh k v - df s d 2 h t = 
dX i dX j ^ dX t dX j dXi ^ dX t dX k dXi dX j ^ dX t dX i dX j ~ 

J t>m ■> t,k>m J t>m J 

From this, the desired second order derivatives qx qx \ x ) can ^ e computed by 
inverting the matrix {§x^(x)). This finishes the proof. □ 
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